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DETECTION  SOICKE  FOR  JUMP  OF  INPUT 
WITH  KNOWN  HE  AN  AND  COVARIANCE  MATRIX* 


Probll  Sanyal  and  C.  It.  Shen«* 
Rensselaer  Polytechnic  Institute 
Trey,  New  fork 


Abstract 


This  paper  discusses  the  use  of  Baye's  rule  for  the  detection  of  the  tire  of  appli¬ 
cation  of  an  irpulse  input  in  a  system,  along  with  the  Kalman  Filter  algorithm  for 
estimation  of  the  system  parameters. 


INTRODUCTION 


In  the  tracking  of  parameters  of  a  system,  there 
ere  situations  when  the  system  undergoes  an  abrupt 
change  of  parameters,  but  the  exact  time  of  this 
di«iiy«  I»  liot  known  a  priori.  This  paper  assumes 
that  the  mean  and  covariance  of  the  jump  of  input 
Is  known.  We  use  Bayes  rule  to  detect  the  time  of 
application  of  this  jump. 

PROBLEM  STATEMENT 

Consider  a  linear  system,  the  dynamics  of  which  Is 
given  by  xi*Fxi- j+rk4ij  (1) 

The  jump  quantity  u  Is  a  Gaussian  random  vector 
with  mean  u  and  covariance  Q,  which  are  known  to 
the  observer.  The  6M  implies  that  this  jump  quan- 
tity  applies  at  a  certain  time  instant  j  wnich  is 
not  known  a  priori.  The  observations  nad?  on  the 
system  are  also  linear  functions  of  the  states  and 
are  given  by  z^H.Xj+v,  (2) 

♦here  is  a  known  observation  matrix  and  v^  is  a 
Gaussian  measurement  noise  vector  with  zero  mean 
and  covariance  R.  It  is  assured  that  a  jump,  if 
any,  occurs  prior  to  a  measurement. 

TRACKING 

The  Kalman  Filtering  is  used  to  find  the  estimate 
Xj*E(Xj|Zj)  where  z(  is  the  collection  of  observ¬ 


ations  to  the  1th  Instant,  i.e. ,r1*(z1,z?,zj,..,z1). 

A  standard  Kalman  Filter  algorithm^  is  used.  The 
estimation  is  started  with  a  given  Initial  estimate 
y.  .  Based  cn  this  quantity .  twn  nredictinns  are 

Q  '  '  ' 

made  for  the  states  at  the  next  stage,  one  assuming 
that  there  has  been  no  jump  and  the  other  assuming 
that  there  has  been  a  ju-ip  before  the  1st  observ¬ 
ation  is  made.  These  will  be  called  x?  and  x)  re¬ 
spectively,  as  shown  in  Hg.  1.  The  subscript  de¬ 
notes  the  stage  referred  to,  while  the  supdVscript 
denotes  the  stage  before  which  jump  is  supposed  to  ■ 
have  occurred.  The  superscript  zero  denotes  that 
no  jump  has  occurred  so  far.  The  superscript  1  in¬ 
dicates  jump  just  before  stage  1.  Fig.  1  shows  how 
the  different  estimates  may  be  obtained  by  assuming 
the  jump  to  have  occurred  at  different  points.  Pro¬ 
ceeding  in  this  manner,  at  every  stage  1,  we  shall 
have  HI  estimates,  one  of  which  is  more  correct 
than  the  others.  A  number  of  stages  can  be  consid¬ 
ered  together,  to  determine  whether  there  has  been 
a  jump.  A  large  nuster  of  stages  will  increase  the 
accuracy  of  detection.  But  as  a  tradeoff  between 
corputational  load  and  accuracy,  only  three  stages 
together  will  be  considered  here.  Thus,  there  will 
be  no  mre  than  four  alternate  estimates  at  any  stage, 
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*  PROBABILITY  DENSITY  FUNCTION  OF  z, 

Thi  observation  Z|  It  a  fiausslan  random  victor^. 

The  nan  and  covarianca  art  easily  shown  to  be 

£(1^  )■!/«*,  (3) 

and  cov(zj)»HjMjh|*Rj  (4) 

Mhtra  Hj  It  the  pre-measurement  covarianca  of  x. 

Me  thall  write  z{  *  N(H,x{,  H^H^R,)  J<1  . 

where  tha  superscript  J  on  z^,  x(  and  denotes 

that  tha  Jump  Is  supposed  to  have  occurred  just  be* 
th 

fora  the  J  measurement. 

JOINT  PROBABILITIES  AND  DETECTION 

With  tha  third  measurement,  consider  the  joint  prob- 
abilities  p(zj ,  z* ,  zj),  p(ZJ ,  z? ,  z*),  p(zo  ,*  ,zy 
and  p(Z0j.to,2^),  one  of  which  will  be  highest  de¬ 
pending  on  when  the  Jump  occurred  or  didn't  occur 
at  aTr3^.  Also,  It  is  expected  that  the  probabil¬ 
ities  will  be  graded  according  to  the  nearness  of 
the  hypothesis  to  the  true  hypothesis.  This  allows 
me  to  coopare  two  adjacent  probabilities  at  a  time 
Instead  of  all  four.  For  example,  compare  p(zj,zj, 
z\)  and  p(z^,z|,z|).  If  the  former  Is  larger,  then 
conclude  that  the  jump  was  Indeed  before  the  1st 
measurement.  If  not,  then  process  one  more  measure¬ 
ment  and  make  similar  comparisons  for  the  next  set 
of  Joint  probabilities  which  does  not  include 
p(zj,zj,zj),  and  so  on. 

EVALUATION  OF  JOINT  PROBABILITIES 

Since  the  observations  are  statistically  independ¬ 
ent^.  the  Joint  probabilities  are  the  products  of 
the  individual  probabilities.  We  use  the  logarithm 
of  the  probabilities,  for  convenience  in  computation. 
Thus,  one  needs  corpute,  with  each  new  estimate,  the 
following  quantity:  Ctn[  i  P(z^)]  * 

!  k«l  * 

where  C  Is  a  negative  constant  for  different  jfi. 
The  x^  Is  obtained  by  Kalman  Filtering  according  to 
Fig.  1.  For  a  certain  j,  the  negative  of  the  log¬ 
arithm  of  the  Joint  probabilities,  i.e.,  the  right 
side  of  the  above  equation  is  the  smallest.  That 
J  denotes  the  time  instant  of  jump.  Note,  that  any 
1>3,  the  only  j's  considered  ire  j=i,i-l,i-2  and 
1*3.  since  the  likelihood  of  a  jump  at  an  earlier 


stag*  has  already  bain  diseardad  in  tha  previous 
sttp.  Thus  at  any  stage,  there  are  no  more  than 
4  estimates  to  bt  mad#  and  four  tuns  to  bo  updated. 
This  restricts  the  size  of  memory  required. 

EXAMPLE 

A  sliple  example  was  chosen  with  F»[>  j  ], 

H«J,  R»['o\m]  and  x_[!53]  Kalman  Filtering  was 
carried  over  30  stages.  The  jump  was  Introduced  at 
one  of  the  30  stages.  The  probability  of  success, 
as  obtained  from  conputor  runs.  Is  given  in  Table  1. 

CONCLUSIONS 


This  paper  gives  a  scheme  for  detecting  a  sudden 
change  In  a  system.  A  previous  paper  by  Schagirt 
Prabhu^  does  not  invalve  any  filtering,  the  pre¬ 
sent  scheme  does.  A  major  difference  between  the 
two  is,  thus,  that  while  the  former  assures  known 
distributions  of  the  measurements,  this  scheme  re¬ 
calculates  the  distribution  at  every  stage.  The 
scheme,  as  tried,  was  quite  successful,  though  nat¬ 
urally  sensitive  to  initial  errors  of  estimation. 

REFERENCES 

1.  "Applied  Optimal  Control",  Bryson  &  Ho,  Blals- 
dell  Publishing  Co. 

2.  "Stochastic  Processes  t  Filtering  Theory", 
Jazwinski,  Academic  Press,  New  York 

3.  "On  the  Detection  of  Sudden  Change  in  System 
Parameters",  K.P.Seshagiri  Prabhu,  IEEE  Trans¬ 
actions  on  Information  Theory,  July  1970. 


1 


■<r 


‘  FIGURE  1 

DIAGRAM  SHOWING  THE  ALTERNATIVE  ESTIMATES 
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Value  of  Z 
0.01 
0.05 
0.10 
0.25 
0.25 
0.50 
1.0 


Value  of  q 
0.25 
0.25 
0.25 
0.5 
0.0 
0.5 
0.5 


Correct  Detection 
Rati o*Ho.  of  trial 

29/40 

32/40 

32/40 

32/38 

40/40 

71/78 

21/22 


TABLE  1 

RESULTS  OBTAINED  FROM  COMPUTER  RUNS 


